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ABSTRACT _ l , . ' . ’ ' 

The objectives of this project to increase the . 
effective ness and efficiency of American Indian education through, the 
Bureau of Indian Affairs (BIA) were (1) a system analysis of the El A 
schools to identify educational ‘goals and objectives ‘ and the critical 
factors contributing to or impeding ee due at ion a 1 effectiveness in 
achieving the goals; (2) formulation of alternative programs 
responsive to the educational goals and objectives, taking into — - 
account the critical factors previously identified; and (3) 
development of cost-effectiveness models for estimating the probable 
impacts and relative efficiencies of alternative programs for 
rational planning and budgeting. ..Goals and objectives were identified 
by a process of interviews and projective exercises with educational 
change ..agents in the BIA education system. Actual operations were » 
observed in 30 BIA schools on 6 reservations and in, Alaska and 
Oklahoma, some 150 programs were formulated to satisfy several 
degrees of budget constraint. Twelve district models were designed’ to 
deal with specific school system planning, school management, and- 
instructional problems. The document contains objectives, methods, 

and results of the . project; a 'd is cushion ' ' of "goal sj 'of “ Indian — 

education; a summary of programs developed to respond to the goals of 
Indian education and its problems..; narrative sketches of the models 
that were designed; and a discussion of the processes of change and - ' 
imolemeritat ion. Related documents are ED 032 991 through ED 032 994. 
(JH) • 
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Chapter X. Objactives, Method s , and Re suits : 

The critical problems of low Indian educational achievement and 
attendant 'poverty have been recognized by the 15 XA for many years, and 
long before their recent "discovery" by the BlA's critics. Until recently, 
however, there was little awareness of the availability of system analysis 
and social science research methods that could be applied to education 
problems. With the increasing application of these methods, to compensa- 
tory education, the BIA Education Division sought to apply them co it* spe- 
cific problems in Indian education, ' 

' The genera-robjective, of the BIA Education Division is to develop 
means for increasing. both the effectiveness and the efficiency of the educa- 
tion of American Indians. Accordingly in May, 1968, a contract was signed 
with Abt Associates Inc. with the intent of jointly developing such means'. 
Aht Associates Inc. had pioneered in the application of system analysis to 
education, in instruction through curriculum innovations such as sirnu- 
lation games for social studies, sciences, and language arts; in tearcher - 
evaluation and training for the Job Corps; and in education system analysis 
and planning using cost-effcctiveness models programmed for computers 
for the .U. 1 S. Office of Education, " . ' 

" The objectives for the project believed to be instrumental to a chic v 
ing the BIA Education Division’s general objective of increased education 

effectiveness and efficiency were agreed to be: ; 

- - A system analysis of the BIA school to identify j 

e dUcational'g'baTs and obj e ctives and the- critical ■ - — y — i- - 
factors contributing to or impeding educational ef- 
fectiveness in achieving the -goals; 

• • ' , - J • 

-- Formulation of alternative programs responsive - - 

to the educational goals and objectives, talcing into * 

1 account the critical .facto rs- previously identified; 

-- Development of cost-effectiveness models for . 

estimating the anttx^fesSjefb--* 

Jo-* - ficiencies of alternative programs for rational 
planning and budgeting. - 



The method employed for carrying out the system analysis was 



the classical five-fold one of identifying goals and. objectives (also known 
as-& 4 ilteria- of. effectiveness), determining the hiituro of the actual operations, j 
estimating ThcT^ri^% pan c i T rg r - b e.fe w&e-n-oiaj e c t ive s. .and. actualities, deter- 
mining what factors are critical to achieving the? goals, and identifying 
available resources and techniques for overcoming obstacles to. the achieve- 



ment of the goals. The last element of the system analysis phase merges 
naturally into the first element of The program sTormulat ion phase. 

Goals and objectives, were identified by a process' of several hundred 
interviews and projective exorcises with representative samples of five 
groups determined to be significant change "agents in the BIA education sys- 
tem: administrators, teachers*, students, parents, and education consul- 

tants. All five groups arc in substantial agreement that the goal of Indian 
education should be the Indian, achievement of equality, of opportunity with 
non-Indian Americans. Equality of educational opportunity, is often defined 
as equal opportunity for high school graduation and college or technical 

school entry. • ’ — ■ . . * 

The phrase "equality of educational opportunity 11 can be defined in 
terms of equality of "inputs, " equality of education processes, or equality 

o£ educational ’‘outputs^ or results, * . ■ ■ 

If .''equality of educational opportunity" is defined in input terms, both - 
inputs of students with their pre-school educations, and the in -school factors 
of teachers, curricula,* facilities , and equipment must be considered. Since 
most Indian 'children begin school with the ..environmental handicaps of rural 
poverty, cultural isolation, . low level of "parent" education, and in many cases 
(particularly Navajo and Eskimo.) a non-English native “language, equality of ■ 
educational inputs requires greatly superior in-school resources of teachers, 
curricula, facilities, and equipment to balance the inadequate pre -school 
preparation of most Indian children. Such superior education has not been 
and cannot be supplied by .the BIA on its curr ent budget of some $1, 000 per, ■ ' , 

student year , which must also pay for the boarding expenses of nearly half 

' * - »' 

the students 4 

.."Byway of comparison, the Job Corps, spent from $7, O00 to $9,00,0 per stu- 
dent year for its resident high s ch o p 1 -* 1 e v e 1 education program. 
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If equality of educational opportunity is defined in process terms, 
then the BIA school system as It operates today offers it, at least the in- 
school part. On the basis of visits to 30 of 250 BIA schools educa ting over 
20 percent of the BIA student population, it can be concluded that most BIA—" 
schools are no better or worse than the average American rural and small- 
town elementary and high schools. 

However, research has shown that out -of -school- learning, in the * 
home and among peers, contributes a major component of childrens 1 educa- 
tion, In this respect, BIA schools do not now. have it in their power to offer 
the out -of- school educational advantages enjqyed by two -thirds of the non - 
Indian' stu den ts-w hose families are not impoverished, Indian homes where 
an Indian language is } spoken obviously do not reinforce tlip English language 
learning of the schools. For boarding school students, the dormitories do 
not offer the ' same environmental enrichment of '.most homes. 

Thus to achieve equality of . educational processes, once again the 
BIA school process must be much better than average, to compensate fqr^ 
the much less than average out -p£- school educational/factors operating dur- 
ing the school years. Unfortunately the BIA schools^ cannot be said to bo 
much bettor than average, so that an overall inequality of educational pro- 
cess exists,- much as an inequality of educational inputs. 

If equality of educational opportunity is defined as equality of edu- 
cational outputs,' then there is also great inequality at present, although 
the inequality is steadily being decreased by BIA -schools On the a vei age, 
Indian students are. over two years behind their non -Indian peers in academic 
achievement, have twice the drop -out rate, arid enter, and graduate from.col- 

■ lege in much smaller percentages. ‘ u ■ 

Most BIA administrators and teacher/s,” Indian students and parents, 
and education- system analysts define educational goals in terms of outputs. 

The goals ohfe quaTihy=of—e-du c ati ona l opp o r tunity are thus defined as the achieve 
ment of a proportion of Indian high school/ and college graduates equal to that 
of non - Indians . 
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Unfortunately this goal is insufficiently specified to provide a firm 
basis for policy decisions. Since e q u a 1 i ty_o f_ a ve rage Indian educational at- 
tainments is not a present reality, its achievement must occur .over- some-pe- 
riod of- time, during which the gap between Indian and non -Indian educational 
■attainments is gradually narrowed until it disappears* This period of time 
over which Indian . equality of educational opportunity is achieved, which may 
be called the ’gap period, 1 is. never specified, -Most of the participants in In- 
dian education are agreed that the gap must be closed but there -has been little 

^ i 

discussion of the schedule. 1 . ' 



The actual operations of BIA schools were observed in 30 schools on 
6 reservations and Alaska and Oklahoma. The, scnools were selected to foim 

a representative sample,' on the basis of a typology of such characteristics 

as size, location, and student population •.(■tribal* mix and composition), * Prin- 
cipals, department heads, teachers, dormitory -.staff, students, Indian corrr^ 
munity representatives , and Indian parents were'; interviewed both formally 
and informally. "'Glass roorhs, dormitories, dining facilities , and extra -cur- 
ricular activities 'were observed in operation by social scientists and educa- 
tors who had been provided with ’obs erva-tion guides’ or checklists. Observa- 
tions were recorded, condensed, summarized, *5pid compared by the analysts 
to provide a consolidated status summary to coiyipare with the educational ob = 

... * ■ - %i 

jectfves. = ■ .* / 

An analysis of the current status of 'BIA/ schools was conducted to de- 
termine the discrepancies with educational objectives, and tile factors criti- 
cal to the achievement of these Objectives. The principal discrepancies bet- 
weeii goals and current status were in: the below-U* S f average educational 
achievements of most BIA school students, the lack of a sufficiently enriching 
extra - cur ricular, environment particularly in the boarding schools, the lack 

ppo r tumbles— to- motTvarte— j ob- di=r e cted- 

education, and lack of sufficient local commimity- ’skill - and.4uitiativ_e,-to^p.a^Jii= — 

■ i . h - \ - , , . ' W-t-Pk ’• V ’ 1 - 

•cipate • actively ' ih-.fKe- direction ^aiid dpe ration of the schools. _ 
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* One notable- exception has been tile 'statement by L. Madison Coombs, 
Director of Research and Evaluation at the BIA Division bf^ Education, to the 
effect that there, should be M an acceleration of the educational growth curve for 
Indians s (doubling ? j which >wil expedite accompli shnlent-- of the following objec - 
tives: (I) high school graduation by virtually all Indian youth > ‘and (2) .continued 
education beyond high s chobl (either college hr vocatiohal-techliical foi all 
who desire it. 11 Meiiao. May lZjU 1968, to. As si stant-Commis sione r Zellers. 



The factor's critical to the. iinpULQJVcmcnt of educational achie vement 
were determined to bo the quality an cl quantity of instruction, majoi env i - 
ronmcntal factors such as dormitory life, and the student-perceived oppor- 
tunities for applying their education to the attainment of economic, social, 
and political objectives* 

The quality of instruction was found to be most strongly related to 
the overall educational leadership of the "schools; the quality of teacher 
recruitment, selection, in-service fcramm^y“an^^iiperv^ s ^ n ; an d the re- . 
levance, motivational effectiveness, and intellectual quality of curriculum 
materials. 

The quality of non-classroom environmental factors, particularly 
dormitories, was found to be dependent chiefly on the quality of dormitory 
guidance, counseling, and other staff; the reasonableness and sensitivity to 
normal youthful needs- of the school regulations; and. the quality and quanti- 
ty of physical facilities. 

The student -perceived opportunities for applying their education to the 
achievement of their own goals - a critical factor in students 1 perception of 
the relevance of any education - seems to be most dependent on employ- 
ment opportunities on or near the reservation* 

The principal obstacles to the achievement of the educational goals 
were determined to be^ cultural and geographic isolation, rural poverty, 
inadequate instruction and counseling for bridging the cultural gaps, and pro- 
blems of school management and administration. 

The BIA education systpin can itself do little to remove the cultural 
and geographic isolation of .most .Indian homes and the rural poverty in which 
they subsist* It can take steps, however, with the approval of the Commission©: 
of Indian Affairs, and the Secretary of the Interior to improve instruction and 
counseling from its present average performance to the; superior performance 
required to overcome the Indian children's environmental handicaps in the 
-achievement of educational equality* The BIA and the Department of the In--.. 

- 1 e r io r-ean-al s o Take-s^tep sfmrefo rm-the pr e s e ntlyu confuse d ad mini s tr ative, 

chain of command^f BIA schools that reduces the effectiveness of their ma-* 

nagement. - , * 1 ' - 

^ . . The system analysis phases produced the identification of objectives, ... 

,;bVhctors ‘cdtical to their attainment, and the major problems to be solved 
4n achieving the Objectives* The system analysis thus prepared the require - 
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moms fui, and sonie of Inc- Key vu riables of, - bot/i prog rr.i>l? Tom ml a t j or; and 
eos t - effect! vene s s nioclcls-clevelopmcnt. The programs were then - designed ■■■ 
to be responsive to the specific problems (goal - reality discrepancies) iden- 
tified, The models were fchen^des. .ignecTa Is a to deal with the most critical 
problems, and 'on tb-- basis of Additional information concerning the critical 
factors in effect! viej less , 



The programs formulation phase of the project oveiTctpped v/ith the 
end of the system analysis phase. With the latter ? s idenlifi cation oferitical 
problem areas and variables, programs could be generated to respond speci- 
fically, The typical program generation process consisted of this sequence: 
problem definition (from the system analysis) . h ___ ■ * 

- identification ofd^ey variables or factors 

- generation of alternative combinations of the key variables to .suggest 

new programs ■ 

- literature search for possibly relevant similar programs 
evaluation of alternative combinations, of variables for their relevance 
and apparent effectiveness in responding to the problem posed 

~ selection of most relevant programs for more detailed consideration 
design of pilot programs to test the fully operational program 
estimation of the startup and annual .operating costs of pilot and 
operational programs, - , - ---- - . ; - 



Some _ 1 50. p mgrain s_ _ware-for mulat-edT^^ht^eig- 
several degrees of budget constrain!; were composed 



r arns T o s a" ITsTyT 



for several budget - 
options: No added expenditure beyond the p r e s c n L B IA-:e duca tion-^budge t -'$-10 
rmlixon additional, $50 million additional, and $100 million additional. - 

The relativ e cos t- eff ectiveness of the programi was estimated omilie 
basis of their relevance to the identified problems , the tlhgree of ^ their .effec- 
tiveness, the. probability of this effectiveness based on the result of similar 
programs , and their costs. Programs were. then listed In descending order • .. 

of their relative- cost-effectiveness. . ‘ '■ ■ * 

* " ■ - < * - 5 ' ••• V ^ S-. ■ ‘ i ■ : ' 
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The cost-effectiveness ’modeling phase was. intended initially to 
produce a single massive education system cost-effectiveness mooch In 
the. course of the system analysis it soon became apparent, however, that 
a set of several more specifically directed long-range planning and 
operations analysis models would be more relevant to t tie noecis of Inc 
users. These would permit modular imp] omenta. lion at appropriate levels 



and 'for appropriate planning .functions, without requiring that a massive 
monolithic model -Vre implemented with computer assistance-before anyone 
obtained any evaluation and planning utility. ~ , - • 

Twelve distinct models were designed to deal with sjsecific school 
system planning, school rnanagementy _;and instructional pi oblems. All the 
models are operable on a manual, human calculation basis. _ They are also 
ready foi\ computer programming and ope ration, should high-volume, 
repetitive use justify this. At the system level, the eight models developed 




~C 



L Population and Enrollment Px’ojection dvlodel 

2. Facilities Use and Planning Model 

3. Economic Projection Model t 

4. Equipment Projection Model . 

5; Personnel Projection Model 

6\ Facilities Location Model • . 

7. Fihdnee Management, Information System Model 
— -S c-ho o 1-In ves t m on t-M o del - — — -- — — — — 




At the school level, four models we re designed for local implemen- 



tation by principals and teachers. These were; 
■ 1. ^Schobl Model . ... 

2, Instructional Process Model t a 

3, Teacher Evaluation Model : 

4, Cur riculum ‘ Evaluation Model 











